Exponential convergence for a convexifying 
equation and a non-autonomous gradient flow 
for global minimization 

G. Carlier * A. Galichon ^ 
April 8, 2011 

Abstract 

We consider an evolution equation similar to that introduced by 
Vese in [lUj and whose solution converges in large time to the convex 
envelope of the initial datum. We give a stochastic control repre- 
sentation for the solution from which we deduce, under quite general 
assumptions that the convergence in the Lipschitz norm is in fact ex- 
ponential in time. We then introduce a non-autonomous gradient flow 
and prove that its trajectories all converge to minimizers of the convex 
envelope. 

Keywords: convex envelope, viscosity solutions, stochastic control rep- 
resentation, non-autonomous gradient flows, global minimization. 

1 Introduction 

In an interesting paper [TU], L.Vese considered the following PDE: 



dtu = y/l + \Vu\^mm{0,Xi{D'u)), u\t=o = uo (1.1) 

where Xi{D'^u) denotes the smallest eigenvalue of the Hessian matrix D'^u. 
Vese proved, under quite general assumptions on the initial condition uq, that 
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the viscosity solution of (11. ip converges as t — t- oo to Uq* the convex envelope 
of Uq. Starting from this result, Vese developed an original and purely PDE 
approach to approximate convex envelopes (which is in general a delicate 
problem as soon as the space dimension is larger than 2). More recently, 
A. Oberman |6], [7], |8], noticed that the convex envelope can be directly 
characterized via a nonlinear elliptic PDE of obstacle type and developed 
this idea for numerical computation of convex envelopes as well. As noticed 
by Oberman, the solution of the PDE he introduced naturally has a stochastic 
control representation. This is of course also the case for the evolutionary 
equation of L.Vese and, as we shall see, this representation will turn out to 
be very useful to obtain convergence estimates. 

In the present paper, we will focus on an evolution equation similar to 
(II. ip and will study some of its properties thanks to the stochastic control 
representation of the solution. Under natural assumptions on the initial 
datum, our first main result is that u{t, .) converges to the convex envelope 
of Mo exponentially fast in the Lipschitz norm. From this convergence, we 
deduce that trajectories of the non- autonomous gradient flow 

x{t) = -Vu{t,x{t)) 

all converge to a minimizer of the convex envelope. 

The paper is organized as follows. In section |51 we introduce the convexi- 
fying evolution equation and recall some basic facts about convex envelopes. 
In section [3l we give a stochastic control representation for the solution of the 
convexifying evolution equation. Section H] gives some regularity properties 
of the solution. Our exponential convergence result is then proved in section 
Oby simple probabilistic arguments. Finally, convergence of the trajectories 
of the non-autonomous gradient flow are proved in section O 

2 A convexifying evolution equation 

In the present paper, we will consider a slight variant of (II. ip . namely: 

dtu{t, x) = min(0, Xi{D'^u{t, x))), (t, x) E (0; oo) x M'^, u\t=o = Uq (2.1) 

In the sequel, we shall refer to (12. ip as the convexifying evolution equation. 
Following the same arguments of the proof of Vese [10] (also see remark 
13.41 below), one can prove under mild assumptions on uq that the solution 
converges pointwise to the convex envelope Uq* of the initial condition. Our 
aim will be to quantify this convergence and this goal will be achieved rather 
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easily by using a stochastic representation formula for the solution of fl2.ip . 
Before we do so, let us recall some basic facts about the convex envelope. 

Given a continuous (say) and bounded from below function uq defined 
on W^, the convex envelope of Uq* is the largest convex function that is 
everywhere below uq. The convex envelope is a very natural object in many 
contexts and in particular in optimization since Uq and Uq* have the same 
infimum but Uq* is in principle much simpler to minimize since it is convex. 
One can also define Mq* as the supremum of all affine functions that are 
below Uq and thus define Uq* as the "Legendre Transform of the Legendre 
Transform" of uq (and this is where the notation "**" comes from). Rather 
than iterating the Legendre transform, let us recall the well-known formula: 

{d+l d+l d+l "j 

J2 ■■ Ai > 0, ^ Ai = 1, ^ XiXi = x\ ,\/xeM.'^ 

i=l 1=1 i=l ) 

(2.2) 

(the fact that one can restrict to + 1 points follows from Caratheodory's 
theorem) which can also be written in probalistic terms as 

ul\x) = mi ^{uo{x + X)) :E(X) = o|. (2.3) 

The latter formula strongly suggests that a good approximation for the con- 
vex envelope should be 

u{t,x):= mi^^^^E(uo{x + \/2a,(iiy,)) | (2.4) 

for large t where {Ws)s>o is a standard Brownian motion, as is a dx (i-matrix 
valued process that is adapted to the Brownian filtration and \a\ stands for 
the matrix norm |o"| := A/Tr(o"cr^). 

In order to keep things as elementary as possible, from now on, we shall 
always assume that Uq satisfies: 

Uo e C^'\R'^), lim = +0O, 3i?o > : mq = «o* outside Br^. (2.5) 

|x|^oo 

The coercivity assumption guarantees that the infimum in formula (12. 2p is 
actually achieved. The assumption that Uq is C^'^ implies that so is Uq* (see 
[S]) and we will see that it also implies that u{t, .) remains C^'^. Finally, the 
assumption that Uq and Uq* agree outside of some ball, eventhough not as 
essential as the previous ones, will be convenient and allow us to work mainly 
on a ball instead of on the whole space. 



3 



3 Stochastic control representation 

As we shall see (but this should already be clear to stochastic control-oriented 
readers), the value function of (12. 4p is in fact characterized by the PDE: 

dtv = mm{0, Xi{D^v)) (3.1) 

in the viscosity sense that we now recall (for the sake of simplicity, we will 
restrict ourselves to the framework of continuous solutions which is sufficient 
in our context): 

Definition 3.1. Let Q be some open subset o/R°' and let v be continuous on 
(0, +oo) X Q, then v is : 

• a viscosity subsolution of 113. 1]) on (0, +oo) x Q if for every smooth 
function ip G C^((0,+oo) x Q) and every (to,Xo) G (0, +oo) x fl such 
that {u — ip){to,xo) = max(o,+oo)xn(M — f) one has 

dtip(to,xo) < mm{0, \i{D^ip(to, xq))) , 

• a viscosity supersolution of 1\) on (0, +oo) x Q if for every smooth 
function ip G C^((0,+oo) x Q) and every (to,Xo) G (0, +cxd) x fl such 
that {u - ip){to,xo) = min(o,+oo)xn(^^ - one has 

dt(p(to,xo) > min(0, Ai(DV(^o,a;o))), 

• a viscosity subsolution of liS. 1]) on (0, +oo) x Q if it is both a viscosity 
subsolution and a viscosity supersolution. 

We then have the following stochastic representation formula for (12.11) : 

Theorem 3.2. There is a unique continuous function u on [0, +oo) x R'^ 
that agrees with uq at t = 0, that is a viscosity solution of 112. 1\} and that 
agrees with u^* outside i?/?,, . It admits the following representation 

u{t,x) = inf^^ |e(^uo(x + J V2aJWs)jY t>0, x eR'^ (3.2) 

where (Ws)s>o is a standard Brownian motion and \a\ stands for the matrix 
norm |cr| := ^Tr((TO"^). 
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Proof. Recalling that for every symmetric matrix S one has 



min(0, Ai(S')) = min Tr(crcr"^S'), 
kl<i 

the fact that formula (13. 2p actually defines a viscosity solution is a classical 
fact from stochastic control theory (see for instance [1] or [H]) and unique- 
ness follows from well-known comparison principles (e.g Theorem 4.1 in [2]). 
Continuity (Lipschitz continuity in fact) of the value function u will be es- 
tablished in section HI 

□ 

Remark 3.3. Optimal feedback control. Very formally, if the solution 
u of the PDE were very well-behaved then, as usual in control theory, one 
could find an optimal feedback (Markov) control depending on D^u (since 
there is no drift). Introduce a time-dependent vector field Z = Z{t,y), as 
follows. If \i{D^u{t,y)) < 0, then let Z(t,y) be a unit eigenvector associated 
to Xi{D'^u{t,y)) and let Z{t,y) = otherwise. So that in any case: 

TT{ait,y)a{t,yfDMt,y))=^HO,MDMt,y)), and \a{t,y)\ < 1, 
where a is the projector 

a{t,y) := Z{t,y)^Z{t,y). 

Of course the problem is that a is not well-defined: not only u does not 
need to be but also it may be the case that Ai < has multiplicity larger 
than 2. Ignoring those serious issues, let us consider the SDE: 

dYt = V2a{t,Yt)dWt 

then a is (again very formally) an optimal feedback control. We then have 
for t > s > 

uit,y)=E[u{s,Yt)\Y, = y], 
and, formally, the envelope theorem gives 

Vu{t,y) = E[Vu{s,Yt)\Ys = y]. 

Finally, notice that the drift of u{t, Yt) is the nonpositive quantity given by 
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Remark 3.4. One has Uq* < u{t, .) < uq and u{., x) is nonincreasing and thus 
monotonically converges to v{x) := \imt^oou{t,x) = inf t^Qu(t,x). Now, as 
shown by Vese in [10], v is necessarily convex (it is a viscosity solution of 
the stationary equation) and since Mq* < u(t, .) < uq this gives v = Uq*. In 
other words, u pointwise monotonically converges to the convex envelope of 
the initial condition. Of course, in view of the representation formula fl3.2p 
and fl2.2p this convergence is not surprising. We shall see in the next sections 
how (13.21) can easily give much more precise informations and provide in a 
simple way very strong convergence estimates. 



4 Regularity properties of u 

Lemma 4.1. If M > is such that uq — "yl-P is concave then u{t, .) — ^1 
is concave for every t > 0. 

Proof. Set fo := Mo — yI-P and let {Xa)aeA be a family of centered, B 
valued, square integrable random variables, then define 



(p{x) = inf E(mo(x + Xa)), X G 



we then have 



^(x) - = inf {E(t;o(x + X,) + ^\X^\^} 

SO that (/? — is concave as an infimum of concave functions. This proves 
the desired claim. 

□ 

Proposition 4.2. Let M := HZ^^-Uolloo; ihen for every {t,s) G (0, +oo) and 
every a; G M*^ one has 

\u{t,x)-u{s,x)\<M\s-t\ (4.1) 
and u(t, .) is C^'^ for every t and more precisely, one has \\D'^u{t, .)||oo < M. 

Proof. Let < t < s, we already know that ^(t, .) > u{s, .). Let us assume 
for a moment that Uq is smooth and let x G M'' and let a be an adapted 
process with values in the set of matrices with norm less than 1 such that 



E 



(uo{x + J V2adW)^ <u{s,x) + e 
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then defining 



Yh:=x+ [ V2adW, 



Uo{Yh),s> h>0 



thanks to Ito's formula, we thus get: 



u{t, x) < E{Zt) < u{s, x)+e- E{Zs - Zt) 



= ^(s, x) + e — E( / Tr(cro" 



t 



< u{s,x) + e + M{s - t) 



and we conclude that (14.1 p holds by letting e — )• 0+. In the general case, 
one applies the same argument to the regularization p„ i< uq (where p„ is, as 
usual, a sequence of mollifyers) and then passes to the hmit to obtain (14. II) . 
Using (12. II) . we then quite easily obtain that 

\i{D'^v{t,x)) > on (0, +oo) x R'^, with w(t, x) := u{t, x) + "^l^^l 

in the viscosity sense which means that as soon as ip is smooth and v — (p has a 
(local or global) maximum at (to, xq) G (0, +oo) x then Ai(D^v9(to, xq)) > 
0. To see that this implies that f (t, .) is convex, we invoke the same arguments 
as in Lemma 1 in p!]. Assume on the contrary that there are to > 0, xq, in 
and A e (0, 1) such that w(to, Aa:o + (l — A)?/o) > Af (to, a;o) + (l — A)f (to, yo). 
Without loss of generality, denoting elements of as {xi,x') G R x M'^"^, 
we may assume that = 0, xo = (1,0) and f(to,0) = v(to, (1,0)) < 0. We 
then choose h G (0,to) and r > such that 

v{t, (0, x')) < 0, v{t, (1, x')) < 0, V(t, x') G [to -h,to + h]x Br. (4.2) 

We then define 



n := {{xi, x') G (0, 1) X Br}, Q := (to - h,to + h) x 



and choose a > such that t>(to, (A, 0)) > 



We then define 



/ / / \ \ /-I \ 'i/i2 '/ \2 

¥?(t, (xi,x)) := -Xi(l -Xi) + -|x I +7r(t-to) 



with /3 and 7 chosen so that 




(4.3) 
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We then have v{to, (A, 0)) - ^{to, (A, 0)) > O^d by (^-(^, v - ^ < on 
dQ, hence v — if achieves its maximum on Q at an interior point of Q, but 
at this point one should have < \i{D'^(p) = —a which gives the desired 
contradiction. This proves that u{t, •) + tI-I^ convex for every t. Together 
with lemma 14.11 this enables us to conclude that u remains semiconvex and 
semiconcave is hence C^'^ with the estimate \\D'^u{t, .)||oo < M. □ 

Proceeding as in the proof of the two previous results and using the fact 
that the PDE is autonomous, one gets: 

Corollary 4.3. Suppose Uq satisfies l{2.5\) . then Essinf Ai(D^-u(t, .)) is non- 
decreasing with respect to t and EsssupA(i(-D^M(t, .)) is nonincreasing with 
respect to t (where Xd stands for the largest eigenvalue). 



5 Exponential convergence to the convex en- 
velope 

Before we state our result concerning the convergence of u{t, .) to Uq*, we 
need two elementary lemmas. 

Lemma 5.1. Let f .■ M'^ — t- M and M > be such that v + ^l-P ^■^ convex, 
then for every r > one has: 

||Vt;||L-(B,) < 2(^M with r' = j^\\v\\L^(B2r) + i^- (5-1) 

Proof. Let r > 0, i? > 0, for x G -B,. a point of differentiability of v (which is 
a.e. the case) and h G Br in R'', one first has 

'^\HL^{Br+R) > V{X + h)- V{x) > Vvix) ■ h - y (5.2) 

Taking r = R, h = r'Vv{x)\/\'Vv{x)\ and maximizing with respect to a; G -Br 
thus gives 

,, ,, 2,, ,, Mr . . 

||Vv||L-(i?.) < -\\v\\L^(B2r) + —■ (5-3) 

We then take R = r' with r' defined by (15. ip and set h = Vv{x)/M, thanks 
to (15. 3p . h G Br, using (15. 2p again, we then get 

lVf(x)P ^ ,, ^ 

< 2\\v\\l^^b^^^,), Va; G Br 



2M 

which finally gives (15. ip . 



□ 
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Lemma 5.2. Let (Bt) be a standard one- dimensional brownian motion, let 
r > 0, X E (— r, r) and 

T := inf{t > : x + Bt ^ [-r, r]} 

then for every t > 0, one has 

T >t) < q{ry^^, with q{r) := ^_ / e ~ds. 

2r 



'2tx 

Proof. Let n be the integer part of t, we then have 

P(r >t)< P(|fife - Bk-i\ < 2r, for = 1, n) 

and since {B^ — Bk-i)k=i,...,n are independent and normally distributed ran- 
dom variables, we immediately get the desired estimate. □ 

Our first main result then reads as 

Theorem 5.3. There exists C > and A > such that 

\\u{t, .) - MqIU- < Ce-^\\/t > 0, (5.4) 

and 

\\Vu{t,.) -VuI*\\loo < Ce-^\yt > 0. (5.5) 

Proof. First let us remark that if x ^ Bjig, there is nothing to prove. Let 
us then remark that, thanks to fl2.5p . there is some ball Bji containing -Brq, 
such that for any x G Bji^, in the formula fl2.2p . it is enough to restrict the 

minimization to points Xi in Br. Let then x G -Brq, let (xi, ...,0:^+1) G -B^ 
and (Ai, A^+i) be nonnegative such that 

d+l d+1 d+1 

^ Aj = 1, ^ XiXi = X, ^ \iUo{xi) = u*Q*{x). (5.6) 

1=1 i=l i=l 

We shall also assume that the points (xi, x^+i) are affinely independent 
(and this is actually without loss of generality for what follows), the coeffi- 
cients Aj are then uniquely defined and are the unique barycentric coordinates 
of x in the simplex K which is the convex hull of the points (xi, ...,Xd+i)- 
We shall also assume that all the coefficients Aj are strictly positive (again 
this is not a restriction). 

Let e > and let as = 0, for s G [0, e], then set 



■, Ti := inf{t >e:x + V2vi (g) Vi{Wt - W,) ^ K} 



and Us — Vi<^vi for s e (£,Ti]. By construction, x + y/2vi<SiVi{Wri —W^) a.s. 
belongs to a facet of K of dimension d — 1. Let us denote by Ki this facet and 
by El the hyperplane parallel to this facet. Let then V2 be J^£- measurable 
and uniformly distributed on S"^ fl Ei and define 

T2 := inf{i > n : X + V2vi (8) 't;i(W,, - W^) + V2v2 (g) 't;2(Wt - W^J ^ Xi} 

and (Ts = "^2 ® V2 for a; G (ri, T2]. 

We repeat inductively this construction d times and define successive 
(random and adapted) times Tk, k — 1, d, directions vi, ...,Vk, and a piece- 
wise constant control as — Vk <S> Vk for s e (rfc_i,Tfc], in such a way that 
X + Jq V2ai^dWs belongs to a facet of dimension d — k for t G [t^jT^+i]. 
Let us extend the control cr by after time Td and set 

Yt:=x + V2 [ asdWs = Y,^r,- 
Jo 

and remark that at time Td the previous process has hit one of the vertices 
of K. By construction (It)* is a continuous martingale and it is bounded 
since it takes values in the compact K, it therefore converges to Y^^ which is 
a discrete random variables with values in the vertices of K, {xi, ...,Xd+i}, 
we then have 

d+l 

E(nj = x = ^p(i;, = x,)x, 

i=l 

which implies that P(5^^ = Xi) = Aj by uniqueness of the barycentric coordi- 
nates. We thus have: 

<(x)=E(^o(nj) (5.7) 

and then using the fact that Y-t takes values in K and that Uq is locally 
Lipschitz: 

u{t,x) < E{uo{Yt)) < E{uo{Yr,)) + || Vixo|U^(x)E(|yi - F.J) 
< u**{x) + diam(ir)||VMo||L-(x)P(rd > t) 

We then remark that 

d ^ _ ^ 

{rd>t}c[j{Tk>^] 

k=l 

where the T^s are the times the process (Kj)s spends on the (random) facet 
Kk-i (setting Kq = K), the previous probabilities can therefore be estimated 
by the probability that a one-dimensional Brownian motion spends more than 
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^^-j-^ time in the interval [— diam(i^'), diam(i^')]. Using lemma we thus 
get 

P(rd > t) < Me"^(*^') 

for constants M and A > that depend only on d and diam(/r). Letting 
e — 7- 0, we then obtain 

u{t,x) < ul*{x) + diam(ir)||Vuo||L°°(E-)Me"^* 

since we already know that .) > Mq*, this terminates the proof of (15 ■4p . 

Finally, the estimate (15. 5 p easily follows from (15 ■4p . lemma ISTTl and the 
fact that u{t^ .) — u^* remains uniformly semiconcave thanks to lemma W7\\ 

□ 

Remark 5.4. Let us remark that in the inequality (15. 4 p in theorem 15. 3[ the 
constant A only depends on the dimension and the diameter of the faces of 
the convex envelope on the set where {uq > Uq*} whereas the constant C 
also depends on the Lipschitz constant of Uq on the set of such faces. In 
(15.51) . C also depends on HD^MoHl""- Note that the fact that Uq is C^'^ is not 
necessary to obtain (15. 4p . it will however be essential for the convergence of 
trajectories of the gradient flow introduced in the next section. 

6 A non-autonomous gradient flow for global 
minimization 

In this final section, we apply the previous results to prove convergence results 
for the Cauchy problem fo the non-autonomous gradient flow: 

x(t) = -\/u{t,x{t)), t > 0, x(0) = xo (6.1) 

where Xq G M*^ is an arbitrary initial position. Thanks to proposition \A.2\ the 
previous Cauchy problem possesses a unique solution that is defined for all 
positive times. Our second main result is then the following: 

Theorem 6.1. Let xq G M'^, and let x{.) be the solution of the Cauchy 
problem then x{t) converges as t ^ oo to some point y^o that is a 

(global) minimum of Uq* . 

Proof. Let us denote by F the (convex and compact) set where Mq* attains 
its minimum. Let y & F, since VuQ*{y) = 0, using the convexity of Uq* and 
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we get 



d /I 
di\2 



x{t) - y 



2) = (V<(i/) - V<(x(t)), - + 

{\/ul*ixit))-Vu{t,x{t)),x{t)-y) 
< Ce-^'\x{t) - y\. 



Prom which we easily deduce that \x(t) —y\ + jc^'^* is nondecreasing so that 
\x{t) — y\ converges as t — )• +00. There exists therefore some (ioo > such 
that 



Now we claim that d^o = 0; assume on the contrary that d^o > and let 
?/ G -F, we then have 



so that by the same computations as above, we obtain that for large enough 
t, one has 



which contradicts the convergence of \x{t) — y| as t — +00. We thus have 
proved that d{x{t),F) — )■ as t — )■ +00 so that all limit points of the tra- 
jectory belong to F. Let yi = lim„x(t„) and y2 = lim„x(s„) with 
tn, Sn — )■ 00 be two such limit points, since \x{t) —yi\ converges as t — i- 00 for 
i = 1,2, we deduce that \yi - 1/2 1 = hnin \x{tn) - Z/2I = lim„ |x(s„) - ^2! = 0. 
Together with the compactness of F, this proves that x{t) converges to some 
y^o & F as t ^ 00. □ 

Remark 6.2. Note that in the previous convergence result, the fact that u{t, .) 
solves (12. ip or equivalently is given by (13. 2 p is not important and not even 
the full force of the exponential convergence is really needed. What really 
matters is 



Any approximation that satisfies this requirement will lead to a non-autonomous 
gradient flow whose trajectories converge to minimizers of Uq*. 

References 

[1] O. Alvarez, J.-M. Lasry, P.-L. Lions, Convex viscosity solutions and 
state constraints. J. Math. Pures Appl. (9) 76 (1997), no. 3, 265-288. 



d{x(t), F) := min \x{t) — y| — )■ rfoo as t — t- 00. 



5 ■.= mm{{Vul*{x) -Vul*{y),x-y) : d{x,F)=d^}>0 




Vu(t, .) — Vmq*||loo is integrable. 



12 



[2] Y.G. Chen, Y. Giga, S. Goto, Uniqueness and existence of viscosity so- 
lutions of generalized mean curvature flow equations. Proc. Japan Acad. 
Ser. A Math. Sci. 65 (1989), no. 7, 207-210. 

[3] M.G. Crandall, H. Ishii, P.-L. Lions, User's guide to viscosity solutions 
of second order partial differential equations. Bull. Amer. Math. Soc. 27 
(1992), 1-67. 

[4] W. H. Fleming, H.M. Soner, Controlled Markov Processes and Viscos- 
ity Solutions, Graduate Studies in Mathematics, 58, Springer- Verlag, 
Apphcations of Mathematics, (1993). 

[5] B. Kirchheim, J. Kristensen, Differentiability of convex envelopes. C. R. 
Acad. Sci. Paris Ser. I Math. 333 (2001), no. 8, 725-728. 

[6] A. Oberman, The convex envelope is the solution of a nonlinear obstacle 
problem, Proc. Amer. Math. Soc. 135 (2007), no. 6, 1689-1694. 

[7] A. Oberman, Computing the convex envelope using a nonlinear partial 
differential equation. Mathematical Models and Methods in Apphed Sci- 
ences (M3AS), Vol. 18. No 5 (2008) 759-780. 

[8] A. Oberman, L. Silvestre, The Dirichlet Problem for the Convex Enve- 
lope, to appear in Trans. Amer. Math. Soc. 

[9] N. Touzi, Stochastic control and application to Finance, Lecture Notes 
available at http://www.cmap.polytechnique.fr/ touzi/. 

[10] L. Vese, A method to convexify functions via curve evolution. Comm. 
Partial Differential Equations 24 (1999), no. 9-10, 1573-1591. 



13 



